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[A METHOD FOR GRAPHICALLY 
DEPICTING DRUG ADVERSE 
EFFECT RISKS] 

Background of Invention 

[0001] Field of the Invention. The present invention relates to an enhanced method for 
depicting the assessment and analysis of the risks of adverse effects resulting from 
the use of a particular drug, either alone or in combination with other drugs, 
nutrients, foodstuffs, beverages, toxins, chemicals, supplements, and other 
substances. 

[0002] Description of the Related Art , In September 1 997, information regarding 

cardiopulmonary disease related to the use of fenfluramine and phentermine ("fen- 
phen") prompted the United States Food and Drug Administration (FDA) to request the 
manufacturers of these drugs to voluntarily withdraw both treatments for obesity from 
the market. Subsequent studies show a 25 percent incidence of heart valve disease 
apparently resulting from diet drug use. Thus, up to 1 ,250,000 people may have 
sustained heart valve damage from these diet drugs and the FDA indicates that this 
may be the largest adverse drug effect that the agency has ever dealt with. 

[0003] Current estimates are that some 2.2 million hospital patients had serious adverse 
drug reactions and more than 100,000 people die each year from adverse reactions to 
prescription drugs. Accordingly, federal officials have recommended that the FDA 
require hospitals to report all serious drug reactions to the agency. The Inspector 
General of the Department of Health and Human Services has also indicated that the 
FDA should also work to identify harmful effects of new drugs and encourage health- 
care providers to rapidly call the FDA with information about drug side effects. As new 
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drugs are introduced at increasing rates, tine FDA will likely need additional resources 
to protect the public from hazardous drug side effects. 

[0004] If one or two adverse drug reactions slip through the FDA's reporting process, the 
results can be tragic for some patients. That is especially true when the adverse 
reactions are rare but serious — such as in the case of liver failure caused by 
medication. All drugs have the potential to harm or kill the people they are designed 
to help. An injection of penicillin can kill in minutes if the recipient is allergic to this 
life-saving drug. Even common aspirin can be deadly. 

[0005] Clinical trials of a new drug often involve a few hundred patients and therefore 
may not reveal that a drug can cause serious injury or death in one patient in 1 0,000 
or even 1 ,000 patients. Accordingly, it is critical for researchers and drug companies 
to be able to analyze and predict adverse reactions among patients in their studies. 

[0006] In addition, in clinical trials for drugs used to treat diseases such as diabetes, 
which affects so many people and is difficult to treat, FDA officials often face 
tremendous pressure to accelerate their approval process. Often, in this "fast-track" 
process, cases of adverse drug effects may slip through reporting procedures. 

[0007] An even bigger challenge to the FDA is the occurrence of adverse drug reactions 
after the drug is on the market. In this case the drug is prescribed to a much larger 
population of patients, many of whom are taking other substances such as extracts, 
nutrients, vitamins, hormones or drugs that might have an adverse effect with the 
prescribed drug. 

[0008] Thus, there is a need for effective depiction of the risk analysis of adverse drug 
effects. Unfortunately, such a system has not been available. 



[0009] 



U.S. Patent No. 6.120,443 to Cohen-Laroque, "Device For Determining The Depth 
of Anesthesia" discloses a method for determining the depth of anesthesia by 
acquiring a patient heart activity signal, converting the analog signal to a digital 
signal, sensing a periodic wave in the signal, determining the frequency of the 
periodic wave in the signal, determining the digital time interval series, calculating the 
fractal dimension of the digital series and calculating the depth of anesthesia based 
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on the fractal dimension. Tine reference also discloses a display means used to show 
the depth of anesthesia. The display means displays correlation dimension 
information. 

[0010] U.S. Patent No. 6,108,635 to Herren et al,, "Integrated Disease Information 
System" discloses a system that supports the development of new medical 
interventions for diseases. The system includes Explorer modules for discovering 
proposed interventions, designing clinical trials, performing pharmacoeconomic 
analysis, and illustrating disease progression for various patients overtime including 
creating disease progression tutorials for a patient. The system also includes the 
ability to display correlations or relationships between selected input variables and 
disease progression measures. This graphical representation allows users to better 
understand and visualize patterns in the data that inform the clinical trial process. 

[001 1] U.S. Patent No. 6,1 51,581 to Kraftson et al., "System For And Method Of Collecting 
And Populating A Database With Physician/Patient Data For Processing To Improve 
Practice Quality And Healthcare Delivery" discloses a system and method for 
administrating a patient management and health care management database. The 
database is built from data collected via patient surveys and contains data relevant to 
the clinical care of patients, the management of the practices to which the patients 
belong, and to the outcome of that health care and practice management. Once the 
data is collected from the patient, the data is entered in digital format and stored in a 
relational database. The data is then analyzed and prepared for dissemination. As part 
of the analysis, the data is scaled, scored and subjected to a battery of statistical tests 
that result in a series of correlative relations. The analyzed data is then presented in a 
printed or graphical format. 

[0012] 

U.S. Patent No, 6,098,062 tojanssen, "Argument Structure Hierarchy System And 
Method For Facilitating Analysis And Decision-Making Processes" discloses a system 
and method for facilitating decision making. At the heart of the system and method is 
a computer program that links data representing argument structure units into a 
hierarchical argument structure. Each argument structure unit includes data 
representing a hypothesis and its corresponding counter-hypothesis, data 
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corresponding to grounds that provide a basis for the hypothesis or counter- 
hypothesis, data linking the grounds to the hypothesis or counter-hypothesis, and 
supporting data. Once all the inputs have been acquired, the hierarchical argument 
structure may be used for decision-making. Visualization programming code displays 
the support for and against each hypothesis at each node in the hierarchy. 

[001 3] U.S. Patent No. 6,076,083 to Baker, "Diagnostic System Utilizing A Bayesian 

Network Model Having Link Weights Updated Experimentally" discloses a diagnostic 
system, which utilizes a Bayesian network model having link weights updated 
experimentally. The system includes an algorithm for quantify^ing the strength of links 
in a Bayesian network, a method for reducing the amount of data needed to 
automatically update the probability matrices of the network on the basis of 
experiential knowledge, and methods and algorithms for automatically collecting 
knowledge from experience and automatically updating the Bayesian network with the 
collected knowledge. The reference also discusses structuring the display of evidence 
data so that it can be more easily filtered and accessed. In particular, the disclosure 
includes a graphical display means for displaying problems and diagnoses. The 
display means provides high level information with the ability to choose to display the 
underlying data that formed the basis of the high level information. 

[001 4] U.S. Patent No. 5,692,1 71 to Andres. "Method of Extracting Statistical Profiles, And 
Use Of The Statistics Created By The Method" discloses a method of extracting 
statistical profiles from a relational data base organized by relation, attribute, and 
index. The profiles are arranged in tables that are included in the database. The 
reference also discloses a method of profile extraction that can be adapted to any 
data type. 

[001 5] Japanese Patent No. 1 1282934, "Medicine Preparation and Medical Diagnosis 
Support Device" discloses a device that stores patient information, medicine 
information, examination information, etc. The device also includes a display 
processing part, which can display the medication information and examination data 
on the same time base. 



[0016] 



Japanese Patent No. 10225500, "Drug Store and Drug Store Information System" 
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discloses a system to indicate tlie safety and effectiveness of two or more drugs 
prescribed at tlie same time. The system allows a user to select the drugs being 
prescribed from a medical supply table. The system then returns information about 
the drugs, which allows a doctor to judge their safety and effectiveness. 

[001 7] U.S. Patent No. 6,2 1 9,674 to Classen, "System for creating and managing 

proprietary product data" discloses systems and methods for creating and using 
product data to enhance the safety of a medical or non-medical product. The systems 
receive vast amounts of data regarding adverse events associated with a particular 
product and analyze the data in light of already known adverse events associated with 
the product. The system develops at least one proprietary database of newly 
discovered adverse event information and new uses for the product and may catalog 
adverse event information for a large number of population sub-groups. The system 
may also be programmed to incorporate the information into intellectual property and 
contract documents. Manufacturers can include the information in consumer product 
information that they provide to consumers or, in the case of certain medical 
products, prescribers of the medical products. 

[001 8] However, none of these references provides an enhanced method for depicting the 
assessment and analysis of the risks of adverse effects resulting from the use of a 
particular drug, either alone or in combination with other drugs, nutrients, foodstuffs, 
beverages, toxins, chemicals, supplements, and other substances. 

[001 9] Thus, there remains a need for an enhanced method for depicting the assessment 
and analysis of the risks of adverse effects resulting from the use of a particular 
substance, either alone or in combination with other drugs, nutrients, foodstuffs, 
beverages, toxins, chemicals, supplements, and other substances. There also remains 
a need for an enhanced method for depicting the assessment and analysis of the risks 
of adverse effects resulting from the use of a particular drug, either alone or in 
combination with other drugs, foodstuffs, beverages, toxins, chemicals, nutrients, 
supplements, and other substances. 

Summary of Invention 
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[0020] 



The present invention pertains to an enhanced method for displaying assessment 



and analysis of the risks of adverse effects resulting from the use of at least one 
substance of interest, comprising: identifying the at least one substance of interest; 
selecting the profile of the at least one substance of interest related to the safety of 
the at least one substance of interest, using at least one filter; analyzing the risks of 
adverse effects resulting from the use of the at least one substance of interest using 
at least one data mining engine; and displaying the results of the analysis of risks of 
adverse effects resulting from the use of the at least one substance of interest in a 
format that permits perception of correlations. Such a format is preferably at least one 
format selected from the group consisting of a radar display for display of 
correlations, a sortable table, and a sortable line listing and where the format contains 
elements linked to data regarding the adverse effects. 

[0021] In a preferred embodiment of the present invention, the enhanced method for 

displaying assessment and analysis of the risks of adverse effects resulting from the 
use of a drug of interest, either alone or in combination with other drugs, nutrients, 
foodstuffs, beverages, toxins, chemicals, supplements, and other substances 
comprises an input device whereby a user can identify the drug of interest, as well any 
other drugs, nutrients, foodstuffs, beverages, toxins, chemicals, supplements, and 
other substances; a selector for selecting the drug of interest's safety profile, adverse 
effect cases, drug reactions, and relationships therebetween, using at least one filter; 
at least one data mining engine preferably selected from the group consisting of (1) a 
proportional analysis engine to assess deviations in a set of the reactions of the drug 
of interest, (2) a comparator to measure the reactions of the drug of interest against a 
user-defined backdrop, and (3) a correlator to look for correlated signal 
characteristics in drug/reaction/demographic information; and an output device 
whereby a user can receive analytic results from the selector, and the at least one data 
mining engine, wherein the output device provides an enhanced depiction the 
assessment and analysis of the risks of adverse effects resulting from the use of a 
particular drug, either alone or in combination with other drugs, nutrients, foodstuffs, 
beverages, toxins, chemicals, supplements, and other substances. 



[0022] 



This enhanced depiction of results of the assessment and analysis of the risk of 
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adverse effects resulting from the use of a drug of interest can be displayed using 
conceptual filters that can be modified based on pertinent variables, such as, age or 
outcome. Assessments of drug adverse effect risks are displayed in both a traditional 
tabular display format and a "radar-like" display format. The radar screen is populated 
with textual information and facilitates perception of correlations, sometimes 
permitting instant perception of correlations. The radar screen will allow zoom, peak 
thresholding, case report detail, drug/drug comparison and drug/therapeutic 
category comparisons. 

[0023] The enhanced depiction method of the present invention relieves the user of the 
need to enter strings of criteria in testing a hypothesis regarding the assessment and 
analysis of the risks of adverse effects resulting from the use of one or more 
particular drugs. The present invention also relieves the user of the need to refer to 
off-line sources to test a hypothesis. Every dimension is afforded an intuitive visual 
display permitting a user to review and select one or more dimensions. 

[0024] It will appreciated that such a method for displaying the assessment and analysis 
of the risks of adverse effects resulting from the use of one or more particular drugs 
is advantageous to the various risk assessors who are tasked with making such 
determinations. Such risk assessors include governmental agents who perform such 
assessment for regulatory purposes, as well as agents of pharmaceutical 
manufacturers who are tasked with such assessments. 

[0025] The present invention, which provides a enhanced method for displaying 

assessment and analysis of the risks of adverse effects resulting from the use of one 
or more particular drugs, offers an enhanced degree of analysis not previously 
available. This enhanced degree of analysis permits the identification of associations 
and, thus, potential causal elements regarding adverse effects resulting from the use 
of one or more particular drugs. 

[0026] ^1^^ present invention provides answers to several key questions that are essential 
to public health. For example, various safety groups, both government and private, 
are charged with monitoring the post-market behavior of drugs and determining 
"signals" that indicate a relationship among adverse reactions, demographics. 
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behavior, environmental exposure, dietary habits and other elements such as 
outcomes. Unexpected or previously unrecognized adverse drug effects can take the 
forms of single reactions, groups of reactions, or increases in a labeled reaction. Such 
adverse drug effects might be due to the higher exposure to the general population 
experienced in post-market therapy or such effects can be a reaction that has a 
demographic (genetic or otherwise) emphasis in an age or gender group. 

Further, with efficient and effective analysis of adverse drug effects, 
pharmaceutical research and development professionals can learn more details of the 
reaction profiles of drugs and the at-risk populations who may be prescribed those 
drugs. This information would allow a more effective selection of lead compounds and 
would produce drugs with less risk of adverse effects. 

The enhanced presentation of results in context-sensitive groupings (for example, 
reactions in a hierarchy or effects in a line) permits visual signal detection on the part 
of the user. The human brain is adept at perceiving certain features (for example, 
linear relationships, clustered data) that the present invention renders meaningful by 
linking to a logic framework. As an example, the present invention presents the 
correlation among variables of a set of adverse event cases, so that, if a high 
correlation is found, it can easily be determined which are the contributing elements. 
By providing a "temperature" scale for displaying a user-selected degree of 
correlation, the present invention allows the user to readily see the relative 
correlation. 

[0029] Thus, the present invention allows for analysis of adverse drug effects with 

enhanced speed and flexibility. The present invention also offers new insights with 
regard to adverse drug effects and augments the existing processes of drug 
development. 

[0030] Accordingly, it is an object of the present invention to provide an enhanced 
method for depicting the assessment and analysis of the risks of adverse effects 
resulting from the use of a particular substance, either alone or in combination with 
other drugs, nutrients, foodstuffs, beverages, toxins, chemicals, supplements, and 
other substances. 



[0027] 



[0028] 
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[003 1 ] It is an object of the present invention to provide displays for assessments of drug 
adverse effect risks in both a traditional tabular display format and a "radar-like" 
display format. The radar screen is populated with textual information and facilitates 
perception of correlations, sometimes permitting instant perception of correlations. 
The radar screen will allow zoom, peak thresholding, case report detail, drug/drug 
comparison and drug/therapeutic category comparisons. 

[0032] It is further an object of the present invention to provide hyperlinking of elements 
in the display so as to enable the user to drill down on those elements to obtain 
additional information. In a particularly preferred embodiment, the data presented in 
the display is hyperlinked to the specific details of the underlying cases. 

[0033] Yet another object of the present invention is to provide a "radar-like" display 
which employs a visual scale in which brighter colors represent a higher degree of 
correlation and duller colors represent lesser degrees of correlation. The method of 
the present invention further allows the user to control the display of this 
"temperature-like" display. This user-control feature permits a user to establish 
threshold values for the display of mean and range values, thus, facilitating perception 
of correlations. 

[0034] It is another object of the present invention to provide a method for linking 
statistics or associations with the underlying supporting cases. 

[0035] It is yet another object of the present invention to provide a method of presenting 
data in a way to permit coherent visual processing. 

[0036] Further, it is another object of the present invention to provide filtering devices in 
great numbers without requiring extensive keyboard entry or outside references. 

[0037] It is still another object of the present invention to provide a method for a user to 
dynamically change scales to uncover the threshold range of difficult-to-predict 
correlations. 

[0038] 

A greater understanding of the present invention and its concomitant advantages 
will be obtained by referring to the following figures and detailed description provided 
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below. 

Brief Description of Drawings 

[0039] Figure 1 is chart indicating the page flow of the present invention; 

[0040] Figure 2 is an overview of the present invention; 

[0041] Figure 3 is a depiction of a home page of the present invention; 

[0042] Figure 4 is a representation of a filter selection page of the present invention; 

[0043] Figure 5 is a representation of a selector page of the present invention; 

[0044] Figure 6 is an illustration of an exemplary pedigree screen of the present 
invention; 

[0045] Figure 7 is a depiction of an exemplary reactions table in the profiler component 
of the present invention; 

[0046] Figure 8 is a representation of a concomitant drugs table in the profiler 
component of the present invention; 

[0047] Figure 9 is a depiction of a demographics table in the profiler component of the 
present invention; 

[0048] Figure 1 0 is an illustration of a report dates table in the profiler component of the 
present invention; 

[0049] Figure 1 1 is a representation of an outcomes table in the profiler component of 
the present invention; 

[0050] Figure 1 2 is a depiction of a reaction filter screen of the present invention; 

[0051] Figure 13 is an illustration of a correlation results screen of the present invention; 

[0052] Figure 14 is a representation of a correlation details screen of the present 
invention; 

[0053] Figure 1 5 is a depiction of a case details screen of the present invention; 
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[0054] Figure 1 6 is an exemplary illustration of a radar screen display of the present 
invention; 

[0055] Figure 1 7 is an illustration of a proportional analysis selection screen of the 
present invention; 

[0056] Figure 1 8 is a representation of a proportional analysis results screen of the 
present invention; 

[0057] Figure 1 9 is a depiction of a tabular version of a proportional analysis screen of 
the present invention; 

[0058] Figure 20 is an illustration of a comparator screen of the present invention; and 
[0059] Figure 21 is a representation of a case list of the present invention. 

Detailed Description 

[0060] The present invention provides an enhanced method for displaying the 

assessment and analysis of the risks of adverse effects resulting from the use of one 
or more particular drugs, either alone or in combination with other drugs, nutrients, 
supplements, vitamins, foods, beverages, and other substances. 

[0061 ] The enhanced method for displaying the assessment and analysis of the risks of 
adverse effects resulting from the use of one or more particular drugs preferably 
includes, in one embodiment, radar-like displays Incorporating intuitive displays 
arranged in a user-selectable configuration. For example, in one preferred 
embodiment of the present invention, the radar-like display can employ a visual scale 
In which brighter colors represent a higher degree of correlation and duller colors 
represent lesser degrees of correlation. The method of the present invention further 
allows the user to control the display of this "temperature-like" display. This user- 
control feature permits a user to establish threshold values for the display of mean 
and range values, thus, facilitating perception of correlations. 

[0062] 

In another preferred embodiment of the present invention, the enhanced method 
for displaying the assessment and analysis of the risks of adverse effects resulting 



Page 11 of 64 



• 



from the use of one or more particular drugs preferably includes the representation of 
tree structures and pathways applied to the various dimensions of the adverse effect 
risk assessment. 

[0063] For purposes of the present invention, a substance shall be understood to include 
one or more elements of the set of drugs, foodstuffs, beverages, nutrients, vitamins, 
toxins, chemicals, hormones, and supplements. 

[0064] Another preferred embodiment of the enhanced method for displaying the 

assessment and analysis of the risks of adverse effects resulting from the use of one 
or more particular drugs preferably includes context-sensitive pull-down menus to 
view and select filters. 

[0065] Still further, another preferred embodiment of the present enhanced method for 
displaying the assessment and analysis of the risks of adverse effects resulting from 
the use of one or more particular drugs preferably includes hyperlinking of elements 
in the display so as to enable the user to drill down on those elements to obtain 
additional information. In a particularly preferred embodiment, the data presented in 
the display is hyperlinked to the specific details of the underlying cases. 

[0066] Another preferred embodiment of the enhanced method for displaying the 

assessment and analysis of the risks of adverse effects resulting from the use of one 
or more particular drugs preferably includes the ability to group data in pre-defined 
clusters in both tables and radar screens so as to enhance a user's pattern recognition 
and visual integration. 

[0067] 

The primary components of a preferred embodiment of the present enhanced 
method for displaying assessment and analysis of the risks of adverse effects are a 
combination of the following: one or more integrated databases; a selector for 
selecting at least one drug for analysis (based on the generic, brand names or 
therapeutic category); a profiler for displaying statistics that describe behavior for the 
drug in multiple dimensions; a series of at least two filters and the means to control 
the at least two filters individually and in combination; at least one of three or more 
data mining engines selected from the group of a correlator, a proportional analysis 
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engine, and a comparator; and a graphical user interface for displaying the results of 
the analysis. 

[0068] A preferred page flow of the present invention is indicated in Figure 1 . Box 1 00 
represents a user login window. If the user successfully logs in and is authenticated, 
then the user is then placed in the home page 1 01 of the present invention. From the 
home page 101 , the user can add a user at the Add a User Box 1 02; download an data 
image at the ImageView Correlation Viewer Box 1 03; review a previously created filter 
at the Filter Contents Pop-up Box 104; review a previously submitted correlation task 
at the Correlated Terms Line Listing Box 105; launch a proportional analysis task at 
the Proportional Analysis Results Page Box 1 08; or query the system with regard to a 
drug at Drug Selector Page Box 1 1 1 . It will be appreciated that the user can query 
regarding a drug by generic name, trade name, or therapeutic category. 

[0069] Preferably, if the user is reviewing a previously submitted correlation task at the 
Correlated Terms Line Listing Box 1 05, then the present invention permits the user to 
access the case list at the Case List Box 106 and, further, permits the user to drill 
down on individual elements in the case list and obtain case details at the Case Details 
Box 107. 

[0070] Preferably, if the user is launching a proportional analysis task at the Proportional 
Analysis Results Page Box 108, then the present invention permits the user to access 
the case list at the Case List Box 1 09 and, further, permits the user to drill down on 
individual elements in the case list and obtain case details at the Case Details Box 
110. 

[0071] Preferably, if the user is querying the system with regard to a drug at Drug 

Selector Page Box 111, then the present invention permits the user to access the drug 
profile at the Profile Page Box 1 1 2, further, permits the user to access the case list at 
the Case List Box 1 1 3 and, still further, permits the user to drill down on individual 
elements in the case list and obtain case details at the Case Details Box 1 14. 

[0072] 

From the Profile page Box 1 1 2, the user preferably can either access more details 
regarding the various dimensions of the risk assessment at the IVIore Details Box 1 1 5 
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or filter in various dimensions of the risk assessment at the Filter in Various 
Dimensions Box 121 . 

[0073] If the user has chosen to access more details, then the user is preferably 

presented with multiple dimensions of the risk assessment from which to access more 
information. Preferred dimensions of risk assessment include, but are not limited to, 
Reactions More Details Box 1 1 5, Concomitant Drugs More Details Box 1 1 6, 
Demographics More Details Box 1 18, Report Dates More Details Box 1 18, and 
Outcomes More Details Box 120. 

[0074] Preferably, if the user has chosen to filter in various dimensions of risk 

assessment, then the user is preferably presented with multiple filters for the 
dimensions of the risk assessment. Preferred filters of dimensions of risk assessment 
include, but are not limited to, Reactions Filters Box 121, Concomitant Drugs Filters 
Box 1 22, Demographics Filters Box 1 23, Report Dates Filters Box 1 25, and Outcomes 
U Filters Box 126. 

^ [0075] The preferred components of the present invention are illustrated in Figure 2, 
a which provides an overview of the method of the present invention. The user 

?J preferably accesses the system of the present invention by means of Home Page 200. 

O From Home Page 200 the user can proceed to the Selector 201 , where the user can 

fi. select a drug for analysis. Having selected the drug of interest, the user can then 

^ preferably proceed to the Profiler 202, which preferably displays statistics that 

describe the behavior of the drug of Interest. From the Profiler 202 the user can then 
preferably proceed to employ one or more Filters 203. which permit recalculation of 
the statistics by selecting among the available variables. Once a set of cases is 
determined, for example, by the use of one or more filters, the cases can then 
preferably be submitted to at least of three or more Data Mining Engines 204. The 
output from the data mining engines is then preferably displayed in a Viewer 205, 
which can present the data in a variety of formats, including, but not limited to a 
sortable table, a sortable line listing, and a radar screen, thus, allowing rapid 
identification of signals and providing the user the ability to drill down to individual 
case details. 
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[0076] 



Alternatively, in another preferred embodiment, from Home Page 200 the user can 



choose a profile from the Profiler 202, apply one or more Filters 203, process the set 
of cases using the Data Mining Engines 204 and display the results with the Viewer 



databases: an external public database characterized by breadth of data across all 
drugs and a database containing internal data of an organization or an individual 
characterized by increased detail with regard to one or more specific groups of drugs. 
It will be appreciated that a database containing the internal data of an individual can 
refer to a number of different situations, including but not limited to the 
biological/ medical/genetic/environmental exposure/behavior/demographics/drug 
sensitivity of an individual. 

[0078] In both cases, the source and purpose of the data may vary, including post- 
marketing surveillance, clinical trial data, health care system data, research databases, 
and literature, among others. 

[0079] The various aspects of the enhanced method for displaying the assessment and 
analysis of the risks of adverse effects resulting from the use of one or more 
particular drugs, for example, the radar-like screens of the correlator and the 
proportional analysis engine, and the sortable line listings of cases, permit a user to 
undertake a logical drilldown in a risk assessment so as to view additional and more 
specific data, while maintaining traceability through the multitude of cases. 

[0080] -|-^^ public database preferably is at least one database selected from either a 

combination of one or more of the FDA's Spontaneous Reporting System (SRS)(after to 
November 1 997)) and the FDA's Adverse Event Reporting System (AERS)(after to 
November 1 997)), the World Health Organization adverse event database, or other 
country-specific regulatory or epidemiological databases, such as the UK Advert 
system and the General Practice Research Database (CPRD). These public databases 
are updated regularly as they release new case data. In a related invention, which is a 
particularly preferred embodiment of the present invention, the present enhanced 
method for displaying assessment and analysis of the risks of adverse effects relies 



205. 



[0077] 



Preferably, the present invention operates on at least one of two integrated 
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upon a derivative of these public databases that has cleaned, parsed in to a relational 
database, and mapped to known dictionaries, and standardized for efficient searching 
and query defining. This preferred derivative database has over 2 million cases 
representing 30 years of adverse events as reported to regulatory authorities. 
Additionally, the derivative database links the adverse event (AE) case data to Medical 
Dictionary for Regulatory Activities (MedDRA), Coding Symbols for a Thesaurus of 
Adverse Reaction Terms (COSTART), and World Health Organization (WHO) Adverse 
Drug Reaction Terminology (WHOART), among others for reactions, and the National 
Drug Code Directory (NCDC), Orange Book or WHO Drug dictionaries for drugs. The 
invention includes the facility to substitute and manage standard dictionaries for all 
dimensions. 



containing internal data of an organization. For example, such an internal database 
could be the proprietary database of a pharmaceutical company or the 
contemporaneous database of a clinical investigator during the course of clinical trials 
upon a drug. 



utilizes a log-on screen. Preferably, access to the present invention is provided by 
means of the Web. The present method preferably supports all browsers including 
Netscape and Internet Explorer for access. In a particularly preferred embodiment, 
different URLs are used for the public database and for the internal database. This 
allows operating in two databases concurrently if two instances of the Web browser 
are opened. It also allows virtually unlimited simultaneous processes, and 
simultaneous processing at various locations. 

[0083] The use of multiple sessions also enable a range of comparisons, in each and 
every dimension. The "differencing engine" or comparator provides immediate 
information on similarities and differences. 

[0084] 1^ another preferred embodiment of the present invention, a home screen is used 
to launch searches, and review results of the analytical engines and prior work. For 
example, from the home screen a user can (1) select a drug to study by either name or 



a [0081] 



In a preferred embodiment, the present method also operates on a database 



O [0082] 



It will be appreciated that one preferred embodiment of the present invention 
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by therapeutic category, (2) recall a previously saved filter (that was created, named 
and saved previously, (3) review previously submitted analyses, or (4) invoke certain 
data mining engines directly. An exemplary version of a home page of the present 
invention is provided in Figure 3. From this home screen, the user can use field 301 to 
select a drug to study by generic name, trade name, or therapeutic category. The user 
can also use field 302 to recall a previously saved query (called a filter). Further, the 
user can use field 303 to recall previously submitted analyses. Additionally, the user 
can use field 304 to invoke the proportional analysis engine. 

[0085] The home page is preferably the user's command center for analysis. The home 
page is preferably always accessible from any other screen. 

iQ [0086] Preferably, the home screen has four areas. The first area is a link to the selector, 
^ thus, allowing a user to easily reach the drug selection screen through any level of 

^ detail on a drug. The second is a filter area. The user can view and apply previously 

yi saved filters. The third section is the data mining engine section which allows a user 

to invoke one or more of the data mining engines. The fourth area permits the user to 

•id" ' 

review previously generated analyses. 

^ [0087] With regard to the selection of a drug, this feature allows a user to select at least 
fy one drug to study and to search for information on that at least one drug by using 

f: either its generic name, its trade name, its therapeutic category, or its chemical name. 

In addition, the invention provides the ability to develop specific other valuable 
taxonomies, such as a "super generic" including all salts of a drug, or a sub-brand, for 
example distinguishing between a once a day version of a drug from a once a week 
version of the drug. 



[0088] 



Concerning selecting a previously saved query, this feature (referred to as a filter) 
is a preferred paradigm to reduce the routine of inputting a previously employed and 
saved query. By establishing parameters for searching, a user does not need to define 
ad hoc queries. Knowledge of the pharmacovigilance domain is used to present users 
with filter/query-building interfaces that are more in line with the thought processes 
and paradigms employed by such users. A user can preserve the set of parameters of 
a query (a filter) each time he/she refines a profile, and further, a user can employ a 
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filter he/she has developed in a previous search the next time he/she wishes to view 
the same or an updated set of cases. 

[0089] For example, Figure 4 provides a representation of a preferred filter screen. 

Various preferred fields of a filter screen are presented, including, but not limited to, 
Reactions (field 400), Concomitant Drugs (field 401), Demographics (field 402), Report 
Dates (field 403), and Outcomes (field 404). 

[0090] In invoking a saved filter, a user is offered the option of viewing or applying 

(querying with) a saved filter, and a pull-down menu allows a user to select one of the 
filters previously created and saved. Pushing the "View" button allows a review of the 
specific details of the filter. In the example provided, a user had created and saved a 
filter he/she had labeled "Filter 2"for a search on Candesartan Cilexetil. The search 
results show the drug's Reactions, including its MedDRA Hierarchy Group (System- 
Organ-Class (SOCs), etc.), and a pull-down menu showing the specific reactions (ear 
and labyrinth disorders, for example) included in the filter. 

[0091] Case sets, as well as drug sets, can be created, named, and saved similar to filters. 
Because these case sets generate a list rather than a logic description, viewing and 
changing are performed with a list manager. Filters, drug sets, and case sets can all 
be combined or merged to provide a rich set of functions, and great flexibility. 

[0092] The preferred parameters of a filter include reactions (listed as "included" or "off*); 
concomitant drugs (listed or "ofF'); demographics (listed as per previously set brackets 
or "off); report dates (listed or "off); and outcomes (listed or "off). If a user wishes to 
apply this saved filter as his/her current query, he/she would click on the "Apply" 
button. At this point, a user would be taken to the profile screens for that drug and 
that set of filters. 

[0093] 

With regard to the review of the previous analysis aspect of the present invention, 
this section of the home page provides information on previous analyses a user has 
run using the correlator engine of the present invention. As illustrated in Figure 3, the 
correlator engine notices provide information on analyses that have been previously 
completed including date and time, task number, and generic drug. Each listing ends 
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with a hyperlink that a user can employ to view the results of the search. A "delete" 
function is preferably provided to manage this list, 

[0094] Concerning the proportional analyzer aspect of the present invention, this 

component looks for large or small deviations in the reactions counts for a set of 
drugs, i.e., comparing drugs to those in their own therapeutic category or to all drugs. 
With a preferred embodiment of the present invention, a user has an option to 
compute for a therapeutic category using a pull-down menu. A user also has an 
option of selecting Bayesian filtering. Bayesian filtering employs a statistical cut-off 
threshold to reduce the affect of rows or columns with a very low number of cases. 
That is, drugs or reactions accounting for less than a certain percent of cases or fewer 
than a set number will be deleted from the matrix (and so noted on the results 
screen). 

[0095] A user preferably has two options in running this analysis: (1) he/she can compute 
information for each drug's reactions in comparison with all of the drugs in the 
system or (2) a user can run an analysis by comparing the selected drug's reactions 
only with those of other drugs in the same therapeutic category. Results are preferably 
presented concurrently on a separate screen. 

[0096] An additional preferred aspect of this home page is a comparator, which is 

available when a user is accessing optionally provided clinical trial data from a drug 
label, or from the clinical trial data of an internal database. The comparator compares 
potential and actual adverse effects of drugs in the pre- and post-market 
environments. 

[0097] The preferred home page of the present invention also provides a user with the 
options to add a user, manage preferences, manage the group of inserts, and to log 
out, among others. 

[0098] 

If a user has selected a query at the Home page, he/she will initiate a query for a 
drug using the drug's generic name, its trade name, its therapeutic category, its 
chemical name, or other custom-defined categories. The search invokes the selector 
page of the present invention. A user selects a drug by clicking on the generic drug 
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link which then takes a user to the profile and general statistics regarding the selected 
drug. A user starts his/her search on the home screen, and then continues it on the 
selector page, by entering or selecting the category of drug he/she wants to search: 
the generic name, the trade name, the therapeutic category or the custom-defined 
categories. The therapeutic category field preferably has a pull-down menu to help 
identify and select the desired field. 

[0099] An exemplary Query Screen page is illustrated in Figure 5, where a user has 

decided to search the therapeutic category of angiotensin converting enzyme (ACE) 
inhibitors, as defined by the drug dictionaries. (Note: In this case the FDA taxonomy 
places certain drugs known as ATM drugs in the ACE category.) Here, the user has 
chosen not to use the generic name field 500 or the trade name field 501 , but rather 
has chosen the therapeutic category field 503. The present system returns with the 
hits corresponding to the selected therapeutic category and are displayed in the query 
screen. In this example, 22 drugs matching the search criteria were found in the "ACE 
Inhibitors" category. The drugs are listed in alphabetical order by their generic name. 
For each generic drug on the list, all trade names and all relevant therapeutic 
categories are presented in pull-down menus. Optionally, custom-defined categories 
can also be shown. The search results also allow access to the drug's "pedigree," or 
lexical mapping information, indicated by a question mark link. 

[01 00] Preferably, a user can stop browsing drugs and go directly to the profile by 
selecting and applying a previously stored filter. 

[0101] With regard to the pedigree function, if a user selects the pedigree icon for the 

selected drug (the question mark in this example), a user is presented with the drug's 
pedigree, which shows the way the drug has been mapped in a drug dictionary and 
thesaurus. 

[01 02] exemplary pedigree screen is presented in Figure 6. This exemplary pedigree 

screen provides a number of preferred fields indicating the cataloging of the data in 
the system of the present invention. Preferred fields include, but are not limited to. 
Map To (field 600), Verbatim (field 601), Source (field 602), Incidents (field 603), Case 
Count (field 604). QEDRx Processing (field 605), Cross-Reference (field 606), and 
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First/Last Reported Reactions (field 607), The data pedigree search not only shows 
how the drug is catalogued in the present invention, It also shows the drug's mapping 
to known dictionaries. These data are displayed in a tabular form, and indicate the 
logical route from verbatim terms to the "map to" terms used to search the database. 
This function informs the user of specific ranges, types of corruption and number of 
each type of corruption in the data that have been corrected. 

[01 03] For example, a preferred pedigree screen of the present invention provides 
categories including Map to. Verbatim, Cross-Reference, Incidents, Case Counts, 
QEDRx Processing, First/Last Reported Reactions, and Source. The Map to category 
shows how the verbatim name was mapped to a generic or trade name. The Verbatim 
category shows the verbatim name the drug was found under in the database. This 
can be any form of the name under which this drug was found in the FDA database, 
and includes misspellings, variations, etc. The Cross-reference category indicates 
which data source contains this verbatim, the SRS database or the AERS database, etc. 
The Incidents category indicates the number of times this verbatim appears in the 
database. The QEDRx Processing category refers to the "cleanup" performed on the 
data. The specific processing steps are defined in a key. The Source category indicates 
which reference data source was used to map this verbatim to a generic. 

[01 04] The key explains the types of processing that the method of the present invention 
performs to standardize drug names and to improve the quality of the reported data. 
The present invention preferably performs five types of processing: spelling correction 
(corrects misspelled drug names and standardizes variations in drug names), noise 
words (words like, for example, "tablets" "Prozac tablets" does not offer further 
information about the drug itself; it simply provides information on how the drug was 
administered), combo words (alphanumerics like "20 mg.," for example, which are 
redundant because already in the database), numerics (the "20"in 20 mg. In this case, 
20 is a numeric and "mg" is a noise word), marks (extraneous typographic symbols, 
such as brackets, dashes, and so forth). Additional aspects of this feature of the 

present invention are provided in U.S. Patent Application Serial No. , filed 

May 2, 2001, entitled Pharmacovigilance Database, which is incorporated herein by 
reference. 
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[01 05] The profiler aspect of the present invention permits a user to navigate various 
dimensions of the selected drug's safety profile and view cases, concomitant drugs, 
reactions, demographics, outcomes, and time intervals using specified filters. Once a 
user is satisfied with the cases profiled, the set of cases satisfying the filter criteria 
can then be submitted to the various data mining engines, including the Correlator 
Engine (CE), Proportioning Engine (PE) and Differencing Engine (DE). Each data mining 
engine is provided with a set-up and a verification step (by means of a page set of 
input parameters). For example, the CE may further weight the different dimensions. 

[01 06] It will also be appreciated that the profiler of this invention allows for continuous 
adjustment and addition to the dimensions. For example, a preferred embodiment 
includes "Repeat Source". Others may contain laboratory results. The invention 
permits expanding and contracting both the profiler and the at least two filters as the 
data changes. 

[0107] As noted above, in the selector component of the present invention, each of the 

drugs in the generic name category is preferably presented in a format that indicates a 
hyperlink. Clicking on a generic drug (in the previous example Candesartan Cilexetil), 
the multi-dimension profile screen is invoked by clicking on a generic drug (in the 
previous example Candesartan Cilexetil). 

[01 08] The idea of profiling a drug is complex, because of the multiple dimensions. The 
invention's profiler separates presenting data on the selected drug into several 
different categories and preferably "billboards" the top ten for immediate visibility. It 
will be appreciated that the user can specify any number for "billboarding." At the top 
of the screen are the generic name of the drug (preferably with a hyperlink to its 
pedigree), all the trade names associated with the drug, and all of the therapeutic 
categories to which it belongs. 

[01 09] -|-|^^ profile feature of the present invention is used to display statistics that 

describe the effects of the drug in multiple dimensions. Each set of data is preferably 
presented in a separate table, headed by an index tab. The preferred data sets 
include, but are not limited to: (1) Reactions; (2) Concomitant Drugs; (3) 
Demographics; (4) Report Dates (for example, dates logged by FDA as report dates for 
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SRS and AERS); and (5) Outcomes. 

[01 1 0] For each dimension there are key actions: all allow filtering and delving for more 
details. The filter action allows a user to set and activate filters for that dimension. 
The "More Details" action brings up all the values that have appeared only in the top 
10 billboard style on the main page. 

[Oil 1] For certain dimensions, for example reactions, the hierarchy of the dimension can 
be selected to change the billboard and detailed views. In the case of reactions, 
MedDRA contains a five level hierarchy. Other dictionaries use two to four levels. The 
present invention accommodates the full range of hierarchies. 

[01 12] Preferably, the profiler feature of the present invention allows grouping 

concomitant drugs by therapeutic category, chemical class, or other custom-defined 
class. 

[01 1 3] With regard to the Reactions dimension, the profiler component of the present 

invention preferably shows reactions to the drug that is being queried. This dimension 
refers to suspected adverse reactions to the selected drug that were reported. A 
suitable reactions table is provided in Figure 7. In this figure, to the right of the 
Reactions tab is a pull-down menu labeled "View" 700, followed by a filter hyperlink 
701 . By utilizing the pull down menu, a user can choose among multiple different 
levels of MedDRA. Of these multiple different levels of MedDRA, four are particularly 
preferred. These are System, Organ, Class (SOC), High Level Group Term (HGLT), High 
Level Term (HLT), and Preferred Term (PT). 

[01 14] In Figure 7, a user has chosen the HLT option. The window in the pull-down menu 
indicates that there are 256 HLTs out of the total of 1 495 HLTs in the current version 
of MedDRA. The Reactions Table 702 shows the Top 10 HLTs of the 256. In this case, 
the reactions include hypertension, disturbances in consciousness, and so forth. For 
each of the reactions, the table presents the Reaction Count (the number of times this 
reaction was listed in the database) and the percentage of reactions that this number 
constituted in the set of reactions for this drug, based on incidents of reactions (not 
cases). 
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[01 1 5] At the bottom of the Reaction Count and % of Reactions columns are numbers 
showing the number of incidents of the reactions at the Top 1 0 HLTs (488) and the 
Total Reactions across all of the 256 HLTs (in this case, 1 752), 703 and 704, 
respectively. 

[01 1 6] The ability to browse statistics, up and down a hierarchy, and within real time, is 
important to keeping risk assessment hypothesis setting and testing within a short 
period of time. The invention provides extensive associative tables and reverse 
indexing to enable such rapid analysis. 

[01 1 7] A hyperlink offering more details concurrently follows the Reactions table, and 
brings up a separate page with all details of this dimension. 

[01 1 8] It will be appreciated that since Reactions, Concomitant Drugs, and Outcomes are 
summarized at the event level, the resultant collection of cases will be different if 
more than one event is associated with a single case. For example, if two reactions are 
recorded in a single case, and both of those reactions parent to the same MedDRA 
SOC, then they will account for two events, and yet would yield only a single case in 
the case listing. 

[01 19] In a preferred embodiment of the present invention, case level percentages and 
percentage relative to drug exposure are also available in the profiler component of 
the present invention. With regard to the Concomitant Drugs dimension of the profiler 
of the present invention, this dimension describes drugs that were also prescribed in 
the cases in which the target drug was found. A suitable example of a Concomitant 
Drugs table is provided in Figure 8. 

[01 20] In this figure, the Concomitant Drugs Table 800 lists the top 1 0 drugs in the 

concomitant category. In this example, hydrochlorothiazide, aspirin, and furosemide 
were among the drugs found in combination with Candesartan Cilexetil in the adverse 
reactions reported to the FDA. 

[0121] -|-|^^ table divides the cases of concomitant drugs into two groups: Suspect and 
Non-suspect (fields 801 and 802 respectively). When an adverse reaction report is 
filed, certain drugs in the case may be indicated as suspect. When considering 
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concomitant drugs, these drugs will be either suspect or not in the cases relating to 
the queried drug (in this case, Candesartan Cilexetil). Thus, in this example there are 
four cases to consider, suspect and non-suspect for the queried drug, and suspect 
and non-suspect for the concomitant drug. 

[01 22] In the example. Hydrochlorothiazide is the drug found to be most frequently 

interacting with Candesartan Cilexetil. The total number of incidents (45) is broken 
out into the Suspect and Non-suspect categories, and the total is also displayed as a 
percentage of cases that mention this concomitant drug (it is assumed a drug is only 
mentioned once per case), in this case 1 0.7996 of the total number of cases involving 
Candesartan Cilexetil. The remaining Top 10 concomitant drugs are listed in order of 
descending frequency. 

[01 23] Because it is difficult to predict the number of drugs that are reported, the drug 

detail section provides browser paging and sorting. Paging and sorting are techniques 
of the invention used to "bubble to the top" the significantly hypothesized items. 

[01 24] Concerning the Demographics dimension of the profiler component, this table 
provides demographic information about the population included in the query. An 
appropriate demographic table in the profiler of the present invention is provided in 
Figure 9. Preferably five age groups, ranging from below 16 to above 75, are included 
in field 900. The data is also preferably broken out by gender (field 901). The category 
totals and percentages are also provided. The detailed listing gives the statistics by 
single age rather than by generational grouping. 

[0125] Regarding the Report Dates dimension of the profiler component, report dates for 
the incidents included in the selected drug query are presented. A suitable report 
dates table is presented in Figure 10. In the example, the time interval (field 1000) is 
the decade 1 990-1 999 and shows the number of reports In each of those years for 
the drug Candesartan Cilexetil. 

[0126] 

The time interval of the incidents included In this query is presented in this table. 
In the example, the ti me interval is 1 990-1 999 and shows the total number of reports 
for that period (field 1001)(446) and the percentage (field 1002)(in this case, 100.0096) 
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of reports for the drug Candesartan Cilexetil that fall within that time interval. By 
selecting the more details link, a user can obtain the breakdown of the reports by 
individual years. 

[01 27] In the Outcomes dimension of the profiler of the present method, case outcomes 
are listed. An appropriate outcomes table is presented in Figure 1 1 . Preferred 
categories include serious outcomes such as congenital anomaly, death, and 
disability, as well as other outcomes. Serious outcomes are preferably presented in 
red, while less- or non-serious outcomes are in black. The Outcomes Table provides a 
table of outcomes (field 1 1 00), a count (field 1101) and percentages of the outcomes 
(field 1 1 02) in each category, as well as totals of serious and non-serious outcomes. 

[0128] The filtering feature of the present invention is a paradigm that reduces the 

routine of constructing ad hoc queries. This filtering feature is context-sensitive and 
relieves a user of the burden of repeatedly defining the parameters of the queries. 
Filtering allows a user to formulate queries in a way more consistent with paradigms 
used by medical professionals, selecting among the active cases and using standard 
dictionaries such as MedDRA and National Drug Code Directory. This filtering features 
preferably allows a user to apply and view filters individually, set filters as a group and 
apply globally, or save and apply filters at a later time. 

[01 29] Data is compiled by the filters selected for each analysis. In the above example, 
filters were established for the reaction query. One of the screens in the profiler 
component was the reactions dimension, providing the Top 1 0 SOCs for the drug 
Candesartan Cilexetil. At the top of the table was a pull-down menu with "View" 
selected, also provided with a filter hyperlink. 

[01 30] Each of the data sets in the Profiler (Reactions, Concomitant Drugs, 

Demographics, Report Dates, and Outcomes) provides a user with the opportunity to 
establish filter parameters in any order. In a preferred implementation, the invention 
tabs the individual filters for convenience, and allows merging with other filters. 

[0131] 

An exemplary filter applied as to reactions is provided in Figure 1 2. This figure 
provides the list of Reaction Filters available for profiling. The filter is based on the 
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MedDRA hierarchy and begins at the SOC level. 

[01 32] The mechanics for working with filters is common to ail dimensions. A user may 
click on any or all of the reactions they would like to have included in the filtered 
reaction profile. 

[01 33] In the example of Reaction filtering, clicking on an SOC brings up the HLGTs for 
that SOC and allows selection at that level. 

[01 34] In a preferred embodiment filtering can be done at all levels. 

[01 35] It will be appreciated that for the more complex filters, such as the reaction filter, 
a range of user friendly aids is provided. For displayed MedDRA leads, preferably a 
tree is used. When it is collapsed, an open box preferably means no selections lower 
in the hierarchy have been identified, a check means all lower selections in the 
hierarchy have been identified, and a new query box is used to indicate unchecked 
box(es) somewhere below in the hierarchy. 

[01 36] Another preferred feature of the present invention is content-based pre-filters. To 
make it easier to switch-off indication-related adverse drug reactions, an 
"indications-related" button is preferably provided in the selection. For labeled 
adverse effects, of which there could be hundreds, the invention preferably provides 
tables (in this case with data from drug labels) to switch off all of the labeled 
reactions. This quickly focuses the user's attention on "unexpected" reactions. 

[01 37] Preferably on the profiler component, the present invention monitors the contents 
of each filter as it is built. At any point, the filter can be saved as an entirely new filter 
or by overwriting an old one, or changing and saving an incremental filter. This 
permits fine tuning of hypotheses regarding adverse drug reactions. 

[01 38] The filter for the concomitant drugs dimension allows selecting or deselecting any 
and each of the concomitant drugs reported in the profiled set of cases. Similar to 
reaction filtering, the concomitant drug dimension filter preferably provides a context 
selector (for example, to switch out a whole therapeutic category). 

[01 39] yi^g demographics filter allows selections of generational or individual age 
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brackets, and male/female selections as well. Generational filters are preferably user 
definable. 

[0140] The report dates dimension allows selection by bracketed years. In addition, in 
another embodiment of the invention, the report dates filter incorporate a link to a 
drug's birth date and allow filtering by "first six months," "first two years," etc. A table 
of drug birth dates relieves the user of the need to separately enter those dates. 

[0141] The Outcome filter allows individual outcome selection, or by serious/non-serious 
grouping. For internal database adverse events, if a custom seriousness set is defined, 
this dimension will be user definable. 

[0142] The analysis provided by the method of the present invention finds "signals" such 
as anomalies in a random population, a change against a known background, or a 
coherent target in a noise background. This is accomplished by at least one of three 
or more data mining engines: the proportional analysis engine (PE), the comparator 
(differencing engine or DE), and the correlator. In a preferred embodiment, the 
proportional analysis engine can be invoked from the home screen, as can be the 
comparator, for selected data. The correlator is invoked after filtering cases from the 
profile page. 

[01 43] The correlator looks for the association of characteristics in literally millions of 
pieces of drug/reaction/demographic information concurrently. 

[0144] Too often in risk assessment, important correlations are hidden by surrounding 
background "noise" that obscures connections among data elements. Using a 
multidimensional vector analysis, the correlator measures the degree of association 
among pairs of values (for example, a drug and a reaction, an age and an outcome, 
etc.). The correlation algorithm is user selectable and definable. The preferred version 

uses a Pearson product-moment correlation known conventionally as "R ^ ". Other 
algorithms can also be used. The invention preferably applies the correlation after 

filtering, greatly enhancing the signal and reducing noise. 



[0145] 



As a preferred example, the profiler screen can provide a number of hyperlinks 
choices, including "Apply Filter" and "Compute Correlations." Selecting "Compute 
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Correlations," a user initiates the correlator engine, using the active set of cases, 
based on the filter in use. While the processing is being carried out, a user is 
preferably returned to the home screen, where a message alerts a user that the 
correlation is being executed. Once the analysis is completed, a user is notified that 
the correlation has been completed and providing a user with the option to view the 
correlation results. 

[01 46] Figure 1 3 provides an exemplary screen presenting the results of a correlated 
search. The line listing of correlated terms (which may be several screens in length) 
consists of the top 200 (this cut-off number can be any number that the user 
specifies and is selectable and sortable) sets of correlated terms for a user's analysis 
on the requested drug. The data compares the correlations between "Term l"and 
'Term 2." For each pair of terms, the screen preferably shows its relative rank (field 
1 303); score (field 1 304)(the term-pair"s correlative value relative to other term-pairs, 
for example, "Female"and "Candesartan "are more "associated" than any other pair of 
terms, for example, in the set of cases containing "Female"and "Candesartan," were 
relatively highly correlated); the identity of the first term (field 1300) and the category 
to which it belongs (field 1 305); and the identity of the second term (field 1 301) and 
the category to which it belongs (field 1 306). 

[0147] Although the product moment correlation has been employed in a number of 

areas, it has typically been used for numerical data. The invention sends the correlator 

a vector comprised almost entirely of categorical terms, a new and previously 

2 

unexplored use of the Pearson R . The present invention's structural database, its 
ability to keep a consistent vocabulary (to name categories of a categorical variable) 

and its ability to provide sufficiently cleaned data regarding adverse drug reactions 

make the correlation meaningful. The present invention's ability to sort results, 

compare significance and handle thousands of cases was not available in the prior art. 

Since the correlator calculates association strength for both known factors (for 

example, age and gender) and rare reactions (for example, adverse drug reactions 

(ADR's)), this invention can identify meaningful relationships not otherwise easily 

observed. 



Page 29 of 64 



[01 48] In addition to viewing the table listing online, a user may also preferably select to 
review the results using a "radar-screen" correlation viewer. On the correlation screen, 
after the "Below are the top 200 correlated terms for your analysis . . .," there is 
preferably a hyperlink that provides the option of viewing the results with the 
correlation viewer. In addition to viewing with the correlation viewer, a user is also 
preferably presented with options to save the file. 

[0149] Two other information screens preferably provide additional information provided 
by the correlation engine. From the correlated terms screen, a user is preferably 
presented with hyperlinks comprising all of the numbers in the Rank column, A 
significance (to a user-selectable "P" value) Is also preferably provided. These 
hyperlinks provide a link to individual case lists. An exemplary correlation details 
screen is provided in Figure 14. 

[01 50] The Correlation Details screen of Figure 1 4 provides the data for each of the cases 
included in that pair of correlated terms. For example, if the term pair in the 
Correlated Terms Screen was "Female"and "Candesartan Cilexetil," this screen provides 
the pertinent information for all of the cases where those two terms were paired. In 
this example, there were 1 8 cases where renal function analyses were correlated with 
Candesartan Cilexetil. For each case, preferably the following information is provided: 
the case ID (field 1401); the gender of the patient (field 1402); the Manufacturer's 
Control Code (field 1403); the FDA Report Receipt Date (field 1404); the patient's age 
(field 1405); the other drugs the patient was taking at the time of the incident(s)(field 
1 406); the patient's reaction(s) to the medications (field 1 407); and whether the 
outcome was Serious (yes or no)(field 1408). By selecting these cases, the user can 
then profile the set of cases. 

[01 51] Additionally, to learn the details of a specific case, a user preferably can click on 
the case ID number of any case on the Correlation Details screen. The resultant 
information is preferably presented in a case details screen. An suitable case details 
screen is presented in Figure 1 5. 

[01 52] ^1^^ ^^^^ Details screen of Figure 1 5 provides detailed information on each 

specific case. In addition to standard information such as the patient's case ID (field 
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1 501), gender (field 1 502), and age (field 1 503), it preferably includes Reactions (field 
1 504)(including detailed information in the As Reported, Preferred Term, High Level 
Term, and High Level Croup Term categories); Concomitant Drugs (field 1 505)(each 
listed by Name, Dose, Route, and Suspect Status); Outcomes (field 1 506); 
Manufacturer Control Code (field 1 507); Manufacturer Date (field 1 508); Adverse Event 
Date (field 1509); Report Type (field 1510); Report Source (field 1511); Case Source 
(field 1512), and Narrative (field 1513), if any. All data, including lab test and genetic 
information can be encoded and displayed. 

[01 53] It will be appreciated that the above-identified information is not the only 

information that can be provided; extra information fields may be also provided. 

[01 54] The adverse effect analysis result of the present invention are preferably 

presented In a format that provides both traditional tabular displays (line listings) and 
innovative "radar-like" displays. By populating a radar screen with textual information, 
a user moves from the cumbersome reading of printouts to the instant perception of 
correlations directly on the screen. Once a signal is identified, a case browser permit a 
user to move through user-defined sorting to the key cases involved. Once again the 
synergistic aspects of the invention come into play. A 'Therapeutic Category" or 
"Labeled Reaction" selector can group the data on the radar screen to enhance the 
signal. An exemplary radar screen display is presented in Figure 1 6. 

[01 55] The proportional analyzer engine of the present invention monitors outliers 

among reactions for drugs, for example, by comparing drugs to all drugs or those in a 
therapeutic class. The proportional analyzer engine can employ a variety of 
algorithms, including, but not limited to, PRR, ODDS ratio, and PRE, among others. 

[01 56] The proportional analyzer is preferably invoked from the home screen. A user is, 
in a preferred embodiment, prompted to select a therapeutic category for analysis by 
the proportional analyzer engine. Alternatively, a drug or a drug set can be selected. A 
user can select the therapeutic category that contains the drug he/she wishes to 
analyze. Bayesian filtering is preferably available as an option to remove noisy results 
due to lower case counts from the analysis. 
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[01 57] In a preferred embodiment of the present invention, a user is prompted as to how 
he/she would like to analyze the drugs and reactions against the reaction counts of all 
drugs in the system, or only against their peers in their therapeutic category. The 
invention again allows cross-operation of its elements. So, for example, a set of cases 
can be filtered to use a background for the proportional analysis or a specific case set 
can be defined. 

[01 58] Upon completion of the proportional analysis, a proportional analysis screen 
preferably presents the results. An exemplary proportional analysis screen is 
presented in Figure 1 7. As presented in the figure, this screen preferably has several 
components, including, but not limited to a matrix showing the results for the relative 
ratios; a data block; and a line listing of the highest 100 relative ratios. 

[01 59] Preferably the proportional analysis screen presents the results of the analysis as a 
colored matrix of cells, indicating the frequency of reactions of various drugs 
compared to their expected normal frequency. The variation is either more or less 
frequent than expected, and the colors of the cells reflect the amount by which the 
observed number of reactions differs from the expected amount. Cells that are more 
darkly colored indicate reaction reporting lower than expected; cells that are gray 
indicate an as-expected value (or a Relative Ratio (RR) of 1); and celts that are more 
brightly colored indicate a greater Relative Ratio; the "hotter" the color (yellow to 
orange to red), the higher the frequency of reactions. 

[01 60] A user may preferably select any cell in the matrix for further information. 

Selecting a specific cell provides details about the drug (field 1 800) and its reaction 
(field 1 801 ), including also the reaction count (field 1 802), the expected reaction 
count (field 1 803), and the Relative Ratio between the two (field 1 804). An example of 
the proportional analysis results screen is provided in Figure 18. 

[01 61] -|.|^^ invention also allows "analytical drill down". That is, the ability to redo the 

analysis, in a preferred case, for a drug and a reaction system-organ-class. The user 
then selects the level (e.g., PT) for re-analysis and is given the results in real time. The 
user can then iterate between high level and detail. It will be appreciated that the 
invention is not restricted to drug and reaction dimensions for proportional analysis. 
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All pairs of the dimensions of the analytical engine (for example, reaction and 
outcomes) can be analyzed. Even within the cases of a single drug, the reactions and 
concomitant drugs could be proportionally analyzed. 



[0162] 



In addition to the graphic display, the proportional analyzer also shows these data 



in a tabular form. Figure 19 is the tabular presentation of the proportional analysis 
results. In this table, the location of the drug (field 1901) and its reaction (field 1900) 
in the matrix are indicated by numbers for row and column, row indicating the 
reaction and column signifying the drug of interest. The remaining three columns in 
the table preferably indicate the reaction count (field 1 902)(with a hyperlink to the 
cases themselves), the expected reaction count (field 1 903), and the Relative Ratio 
(field 1904). The entries are ranked in descending order, with the highest ratios listed 
first. The columns can preferably be sorted by clicking on their headings. 

[01 63] As in all tables, from the selector to the correlator, numbers are hyperlinked to the 
case-list. In the proportional analysis engine, all HLTs are available. 

[01 64] Such an enhanced display of results of the assessment and analysis of the risk of 
adverse effects resulting from the use of a drug of interest permits a user to reach 
rapid conclusions by enhancing signal processing of the results by the user. In the 
display of the present invention, a user can look across all data visualizations and 
quickly discern patterns which might otherwise have been obscured beneath a large 
amount of data. 

[01 65] jy^^ enhanced display of the assessment and analysis of the risk of adverse effects 
resulting from the use of a drug of interest of the present invention exploits a 
particular strength of the human mind, pattern recognition. The enhanced display of 
the present invention provides a user with data in a format that permits rapid pattern 
recognition. For example, when a user is assessing causative elements, the user must 
first determine whether a particular parameter is significant. The preferred format of 
the display method of the present invention permits a user to rapidly ascertain the 
significance of a correlation. For example, the correlator can be set to display a bright 
dot for a user-defined level of correlation. The graphical user interface of the present 
invention will then display the row of all of the primary putative causative elements. If 
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there are other darker dots in that row, there might be another causative element in 
the corresponding column. In this example, if a bright dot is under the primary drug 
and a darker dot is under one age group, that would suggest that the drug might be 
demonstrating an adverse effect with regard to that age group. 



[0166] 



Another significant aspect of the enhanced display of the assessment and analysis 



of the risk of adverse effects resulting from the use of a drug of interest of the 
present invention is that the visualization data is further linked to additional 
information. Conventionally, a graphical user interface has been used to display 
information, but not to facilitate decisions. The present invention seeks to provide not 
only information, but suggest approaches for hypotheses and decisions. For example, 
with a graphic display method of the present invention, a bright dot indicates a high 
correlation; that bright dot of the graphical display of the present invention is linked 
to the putative causative elements, to the cases, to the profile, and to the filter. 

[01 67] The graphical display of the present invention also preferably provides multiple 
hyperlinks to information and permits toggling to a line listing format for the 
information. This format permits a user, by means of multiple sorting in a columnar 
line listing, to drill down into a data set. 

[01 68] Such sorting permits a user to utilize hierarchical processing with regard to the 
various parameters involved in the sorting. Upon completion of the hierarchical 
processing, the user can then exploit the hyperlinking which preferably underlies each 
datum. 

[0169] Thus, in a preferred embodiment, the graphical display of the present invention 
offers a user a visual display for pattern recognition; a line listing correlated with the 
visual display; dynamic sorting of line listing; and hyperlinking of the elements 
provided in either the visual display or the line listing. 



The comparator or differencing engine screen in the preferred offering offers 
three sets of analyzed data: Pre/Post Market data, Other Post-Market Reaction, and 
Other Clinical Trial Reaction. An exemplary comparator screen is provided in Figure 
20. The Pre/Post Market data is preferably organized into a series of columns in a first 



[01 70] 
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table (field 2000), providing the information, Including Reaction HLT (field 2001); 
Clinical Trial Reaction (field 2002); Clinical Trial Percentage (field 2003), Clinical Trial 
Adjusted Percentage (field 2004); Post Market Reaction (field 2005); Post Market 
Percentage (field 2006); Post Market Adjusted Percentage (field 2007); and Difference 
Ratio (field 2008). The adjusted percentages account for proportions of those 
reactions that are common in both pre- and post-market reporting. The second table 
(field 2009)lists Other Post-Market Reaction (field 201 0)and each reaction's Post- 
Market Percentage (field 201 1). This information represents data available in the 
integrated public database. The third table (field 201 2)provides Other Clinical Trial 
Reaction (field 2013)and each reaction's Clinical Trial Percentage (field 2014). This 
information indicates whether this reaction was mentioned on the manufacturer's 
package insert. 

[01 71] The comparator engine of the present invention is a differencing engine that is 

applied to measuring one drug's reactions, both pre- and post-market. This engine is 
essentially a "proportion of proportions" and is preferably limited to situations where: 
labeled adverse effect data can be quantified, terms can be mapped to MedDRA, and a 
useful number of reports are available for reactions, both pre- and post-market. The 
comparator can compare any two sets of cases for any two dimensions. 

[01 72] In viewing the results of the method of the present invention, when a box on a 
table or in a matrix or a hyperlink is selected, the case listing is generated. When a 
user clicks on any of the numbers, he/she is provided with a listing of each of the 
cases corresponding to that link. An exemplary Case List is provided in Figure 21 . For 
each case, various information is provided, including case ID (field 2100), gender 
(field 2101), Manufacturer Control Code (field 2102), FDA Report Receipt Date (field 
2 1 03), Age (field 2 1 04), Drugs (field 2 1 05), Reactions (field 2 1 06), Seriousness (field 
2107)(Y/N or normal outcome (optional)). These columns can be sorted by clicking on 
their headings. If a user selects a summary view, a profile of the cases in the case list 
is then calculated and displayed. Additionally, if a user wishes to learn the details of a 
specific case, he/she can click on the case ID number of any specific case on the 
correlation details screen. 
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[01 73] This Case Details screen provides detailed information on each specific case. In 

addition to standard information such as the patient's case ID, gender, and age, it also 
includes Reactions (including detailed information in the As Reported, Preferred Term, 
High Level Term, and High Level Group Term categories); Concomitant Drugs (each 
listed by Name, Dose. Route, and Suspect Status); Outcomes; Manufacturer Control 
Code; Manufacturer Date; Adverse Event Date; Report Type; Report Source; Case 
Source; and Narrative, if any. As will be appreciated, additional details can be 
provided. If these details are structured, all features of the invention are expandable 
to that dimension. If the information is unstructured, the invention can extract and 
structure the data using the dictionary and thesaurus facilities. 

[0174] Various preferred embodiments of the invention have been described in fulfillment 
of the various objects of the invention. It should be recognized that these 
embodiments are merely illustrative of the principles of the invention. Numerous 
modifications and adaptations thereof will be readily apparent to those skilled in the 
art without departing from the spirit and scope of the present invention. 
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